IN THE CLAIMS 
Please amend the claims as follows: 

1. (Currently Amended) A system for integrative analysis of 
intrinsic and extrinsic audio-visual data, the system comprising: 

an intrinsic content analvoor analvzer . the intrinsic 
content analyser analyzer being -communicatively connected to an 
audio-visual source, the intrinsic content analvaer analyzer being 
adapted to search the audio-visual source for intrinsic data and 
being adapted to extract intrinsic data using an extraction 
algorithm, 

an extrinsic content analvser analvzer . the extrinsic 
content analvsor analyzer b eing communicatively connected to an 
extrinsic information source, the extrinsic content analys e r 
analyzer being adapted to search the extrinsic information source 
and being adapted to retrieve extrinsic data using a retrieval 
algorithm, and 

a processor configured to correlate the intrinsic data and 
the extrinsic data for providing a multi3Qurc e m ulti-source data 
structure, wherein the intrinsic content analyzer, the extrinsic 
content analvser analyzer , and the processor are included in a 
single device. 

2. (Previously Presented) The system according to claim 1, 
wherein the retrieval of the extrinsic data is based on the 
extracted intrinsic data. 
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3. (Previously Presented) The system according to claim 1, 
wherein the" extraction and/or retrieval algorithin( s ) is /are 
provided by a module. 

4. (Previously Presented) The system according to claim 1, 
wherein a query is provided by a user, the query being provided to 
the extraction algorithm and wherein the intrinsic data is 
extracted in accordance with the query. 

5. (Previously Presented) The system according to claim 1, 
wherein a query is provided by a user, the query being provided to 
the retrieval algorithm and wherein the extrinsic data is retrieved 
in accordance with the query. 

6. (Previously Presented) The system according to claim 1, 
wherein a feature reflected in the intrinsic and extrinsic data 
includes textual, audio and/or visual features. 

7. (Previously Presented) The system according to claim 1, 
wherein the extracted data include textual, audio and/or visual 
features . 

8. (Previously Presented) The system according to claim 1, 
wherein the extrinsic information source is connected to and may be 
accessed via the Internet . 
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9 . (Canceled) . 



10. (Currently Amended) The system according to claim 1, 
wherein the extrinsic content analvQcr analyzer include knowledge 
about screenplay grammar, and wherein the extrinsic data is 
retrieved based on information extracted from the screenplay by use 
of the screenplay grammar. 

11. (Previously Presented) The system according to claim 1, 
wherein the identification of persons in a film is obtained by 
means of the screenplay. 

12. (Currently Amended) The system according to claim 1, 
wherein a feature in a film is analvsed analyzed based on 
information included in the screenplay. 

13. (Currently Amended) The system according to claim 1, 
wherein the correlation of the intrinsic and extrinsic data is time 
correlation, thereby providing a multisourcQ m ulti-source data 
structure where a feature reflected in the intrinsic data is time - 
correlated to a feature reflected in the extrinsic data. 

14. (Currently Amended) The system according to claim 13, 
wherein the time correlation is obtained by an alignment of a 
dialogue in the screenplay to the spoken text in the film and 
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thereby providing a timestampcd time- stamped transcript of the 
film. 

15. (Currently Amended) The system according to claim 14, 
wherein a speaker identification in the film is obtained from the 
timcotampod time-stamped transcript . 

16. (Previously Presented) The system according to claim 1, 
wherein the screenplay is compared with the spoken text in the film 
by means of a self -similarity matrix. 

17. (Currently Amended) The system according to claim 1, 
wherein a high-level information structure is generated in 
accordance with the multisource m ulti-source data structure. 

18. (Previously Presented) The system according to claim 17, 
wherein the high-level information structure may be stored on a 
storage medium. 

19. (Currently Amended) The system according to claim 17, 
wherein an updated high-level information structure is generated, 
the updated high-level inf oirmation structure being an already 
existing high-level information structure which is updated in 
accordance with the multisource m ulti-source data structure. 
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20. (Previously Presented) The system according to claim 1, 
wherein the retrieval algorithm is a dynamic retrieval algorithm 
adapted to dynamically update itself by including additional 
functionalities in accordance with retrieved extrinsic data. 

21. (Previously Presented) The system according to claim 20, 

wherein the additional functionalities is obtained by training the 
retrieval algorithm on a set of features from intrinsic data using 
labels obtained from the extrinsic data. 

22. (Previously Presented) The system according to claim 1, 
wherein the training is performed using at least one screenplay. 

23. (Currently Amended) The system according to claim 1, 
wherein an automatic ground truth identification in a film is 
obtained based on the multisourco m ulti-source data structure for 
use in benchmarking algorithms on audio-visual content. 

24. (Previously Presented) The system according to claim 1, 
wherein an automatic scene content understanding in a film is 
obtained based on the textual description in the screenplay and the 
audio-visual features from the film content. 

25. (Currently Amended) The system according to claim 1, 
wherein an automatic labQlling labeling in a film is obtained based 
on the multiaourcQ m ulti-source data structure. 
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26. (Currently Amended) A method for integrative analysis of 
intrinsic and extrinsic audio-visual information, the method 
comprising the acts of: 

searching by a device an audio-visual source for intrinsic 
data and extracting intrinsic data using an extraction algorithm— i. 

searching by the device an extrinsic information source 
and retrieving extrinsic data using a retrieval alaorithm-7 — ; and 

correlating by the device the intrinsic data and extrinsic 
data, for providing a multisourcQ m ulti-source data structure. 

27. (Currently Amended) The method according to claim 26 
further comprising the step of generating a high-level information 
structure in accordance with the multioource m ulti-source data 
structure . 

28. (Currently Amended) The method according to claim 26, 
wherein the extrinsic content analvocr analyzer include knowledge 
about screenplay grammar, and wherein the extrinsic data is 
retrieved using information extracted from the screenplay by use of 
the screenplay grammar. 

29. (Previously Presented) The method according to claim 26, 
wherein the retrieval algorithm is updated by training the 
algorithm on a set of extrinsic data. 
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Claims 30-32 (canceled) 
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